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In re patent application of 

Applicant: John R. Hershey, et al. 
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For: Speech Detection and Enhancemenr~using Audio/Video Fusion 
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Information Disclosure Statement 

Commissioner for Patents 
P.O. Box 1450 
Alexandria, VA 22313-1450 



Sir: 



1 . Pursuant to 37 C.F.R. 1 .97 and 1 .98, and in compliance with 37 C.F.R. 1 .56, the Office's attention is directed to 
the patents, publications and other information listed on the attached PTO-1449. A copy of each listed document is 
enclosed except for: (a) pending applications or (b) those previously cited or submitted to the Office in the following 
application(s) upon which this application relies for an earlier filing date under 35 U.S.C. 120: 



Serial No.: 
Filing Date: 



Regarding any document, publication or other information for which a date is not given on the attached PTO-1449, 
Applicant(s) believe(s) the same may qualify as "prior" art to this application and should be treated accordingly, 
although Applicant(s) reserve(s) the right to contest the prior art status of any document, publication or information, 
should issue arise. 



2. Regarding each listed document that is not in the English language, an English-language translation accompanies 
this Statement as indicated on the attached PTO-1449 or a concise explanation of the relevance of the document is set 
forth in the following document(s): 

(a) Copy of each English language version of a search report indicating the degree of relevance found by 

the foreign office of each document being submitted from the search report. 

(b) Attachment entitled "Concise Explanation of Relevance of Non-English Language Documents". 

3. Pursuant to 37 C.F.R. 1.97(b) this Statement is being filed (one must be checked): 

(a) _X_ Within 3 months of the filing date or date of entry into the National Stage. 

(b) Before the mailing date of a first Office Action on the merits. If this Statement is not filed before the 

mailing date of a first Office Action on the merits, the required certification is given below or, in the 
absence thereof, the Office is authorized to charge the required fee set forth in 37 C.F.R. 

(c) After the period set forth in 37 C.F.R. 1 .97(b) but before the mailing date of either a final action or a 
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notice of allowance. 

( 1 ) The required certification is given below, or 

(2) Enclosed is a check covering the fee set forth in 37 C.F.R. 1.1 7(p) for consideration of this 

Statement. 

(d) After the mailing date of either a final action or a notice of allowance, but before payment of the issue 

fee. Petition hereby is made for consideration of this Statement and the required certification is 
indicated below. 

(1) Enclosed is a check covering the fee set forth in 37 C.F.R. 1.17(i)(l), or 

4. Certification (if applicable) 

(a) The undersigned hereby certifies that each item of information contained in this Statement was cited in 

a communication from a foreign patent office in a counterpart foreign application not more than 3 
months prior to the filing of this Statement. 

(b) The undersigned hereby certifies that no item of information contained in this Statement was cited in a 

communication from a foreign patent office in a counterpart foreign application or, to the 
undersigned's knowledge after making reasonable inquiry, was known to any individual designated in 
37 C.F.R. 1 .56(c) more than 3 months prior to the filing of this Statement. 



Respectfully Submitted, 
AMIN & TUROCY, LLP 

By ^jufji^A 



AMIN & TUROCY, LLP Jeffrey R. Sadlowski 

24™ Floor, National City Center Reg. No. 47,914 

1900 E. 9 ,h Street 
Cleveland, Ohio 44114 



CERTIFICATE OF MAILING 
I hereby certify that this correspondence (along with any paper referenced as being attached or enclosed) is 
being deposited on the below date with the United States Postal Service with sufficient postage as first class 
mail in an envelope addressed to Commissioner for Patents, P.O. Box 1450. Alexandria, ^Sj*"23313-1450. 

Date: §~t1~Z(it$ <*=HrO-, # , 

Jeffrey R. Sadlowski 



PTO/SB/08B (10-01) 
Approved for use through 10/31/2002. OM8 0651-0031 
U.S. Patent and Trademark Office: U.S. DEPARTMENT OF COMMERCE 
Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB 
control number. 
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Substitute for form 1449B/PTO 

INFORMATION DISCLOSURE 
STATEMENT BY APPLICANT 

(use as many sheets as necessary) 


Complete if Known 


Application Number 


10/608,988 


Filina Date 


June 27, 2003 


First Named Inventor 


John R. Hershey 


Group Art Unit 


Unknown 


Examiner Name 


[Unknown 
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Attorney Docket Number 


MS302I00.1/MSFTP436US J 



OTHER PRIOR ART - NON PATENT LITERATURE DOCUMENTS 


Examiner 


No. 1 


Include name of the author (in CAPITAL LETTERS), title of the article (when appropriate), title of the 
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H. ATTIAS, A. ACERO, J.C. PLATT, and L. DENG. Speech Denoising and Dereverberation using 
Probabalisitic Models, Microsoft Research, 2002. 7 pages. 

M.J. BEAL, H. ATTIAS, and N. JOJIC. Audio-video Sensor Fusion with Probabalistic Graphical Models, 
Microsoft Research, 2002. 15 pages. 

V.R. DE SA and D. BALLARD. Category Learning through Multi-Modality Sensing. In Neural 
Computation, 10(5), 1998. 24 pages. 

BRENDAN FREY and NEBOJSA JOJIC. Estimating Mixture Models of Images and Inferring Spatial 
Transformations using the EM Algorithm. In Computer Vision and Pattern Recognition(CVPR), 1999. 7 

J. HERSHEY and M. CASEY. Audio-visual Sound Separation via Hidden Markov Models. In T.G. 
Dietterich, S. Becker, and Z. Ghahramani, editors, Advances in Neural Information Processing Systems 14, 
pages 1 1 73- 1 1 80, Cambridge, MA, 2002, MIT Press. 

J. HERSHEY and J.R. MOVELLAN. Audio Vision: Using Audio-visual Synchrony to Locate Sounds. In In 
Advances in Neural Information Processing Systems 12. S A. Solla, T.K. Leen, and K.R. Muller(eds.), pp. 
813-819, MIT Press, 2000. 





J Examiner 




Date 


1 


I Signature 




Considered 





•EXAMINER: Initial if reference considered, whether or not citation is in conformance with MPEP 609. Draw line through citation if not in conformance 



1 Applicant's unique citation designation number (optional). 2 Applicant is to place a check mark here if English language Translation is attached. 
Burden Hour Statement: This form is estimated to take 2.0 hours to complele. Time will vary depending upon the needs of the individual case. Any 

+ comments on the amount of time you are required to complete this form should be sent to the Chief Information Officer, U.S. Patent and Trademark 
Office, Washington, DC 20231. DO NOT SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Assistant Commissioner for Patents, 
Washington, DC 20231. 




